Awareness Is Bliss: How Acquiescence Affects Exploratory Factor Analysis.

Assessing the measurement model (MM) of self-report scales is crucial to obtain valid measurements of individuals' latent psychological constructs. This entails evaluating the number of measured constructs and determining which construct is measured by which item. Exploratory factor analysis (EFA) is the most-used method to evaluate these psychometric properties, where the number of measured constructs (i.e., factors) is assessed, and, afterward, rotational freedom is resolved to interpret these factors. This study assessed the effects of an acquiescence response style (ARS) on EFA for unidimensional and multidimensional (un)balanced scales. Specifically, we evaluated (a) whether ARS is captured as an additional factor, (b) the effect of different rotation approaches on the content and ARS factors recovery, and (c) the effect of extracting the additional ARS factor on the recovery of factor loadings. ARS was often captured as an additional factor in balanced scales when it was strong. For these scales, ignoring extracting this additional ARS factor, or rotating to simple structure when extracting it, harmed the recovery of the original MM by introducing bias in loadings and cross-loadings. These issues were avoided by using informed rotation approaches (i.e., target rotation), where (part of) the rotation target is specified according to a priori expectations on the MM. Not extracting the additional ARS factor did not affect the loading recovery in unbalanced scales. Researchers should consider the potential presence of ARS when assessing the psychometric properties of balanced scales and use informed rotation approaches when suspecting that an additional factor is an ARS factor.

The Pragmatic American Revisited: A Direct Replication of Pickett and Baker (2014).

In 2014, Pickett and Baker cast doubt on the scholarly consensus that Americans are pragmatic about criminal justice. Previous research suggested this pragmaticism was evidenced by either null or positive relationships between seemingly opposite items (i.e., between dispositional and situational crime attributions and between punitiveness and rehabilitative policy support). Pickett and Baker argued that because these studies worded survey items in the same positive direction, respondents' susceptibility to acquiescence bias led to artificially inflated positive correlations. Using a simple split-ballot experiment, they manipulated the direction of survey items and demonstrated bidirectional survey items resulted in negative relationships between attributions and between support for punitive and rehabilitative policies. We replicated Pickett and Baker's methodology with a nationally representative sample of American respondents supplemented by a diverse student sample. Our results were generally consistent, and, in many cases, effect sizes were stronger than those observed in the original study. Americans appear much less pragmatic when survey items are bidirectional. Yet, we suggest the use of bidirectional over unidirectional survey items trades one set of problems for another. Instead, to reduce acquiescence bias and improve overall data quality, we encourage researchers to adopt item-specific questioning.

Shades of doubt: Measuring and classifying vaccination confidence in Europe.

The anti-vaccination movement, vaccine hesitancy, and wavering vaccination confidence have increasingly become matters of public interest, in parallel with an increasing normalization of representations of vaccination as risky. In this study, we used data on vaccination beliefs and behaviors from two Eurobarometer surveys to classify attitudes towards vaccination and to discuss comparability, acquiescence, and other measurement issues. Through cluster analysis, we found that individuals in the European Union (EU27) can be classified into five opinion types, differentiating the poles ("vaccine-trusting" and "vaccine-distrusting") from the "hesitant & free choice" cluster and from two relatively uncommitted clusters, the "agreeable" (or acquiescent) and the "fence-sitters." Opinion configurations on vaccination were linked to the broader social structures of age, gender, and educational attainment, to experiences of adult vaccination, and trust in different information sources. We found that trust, distrust, and confusion about vaccination have permeated all social strata in EU countries. The pandemic years have amplified uncertainty concerning vaccine safety and its effectiveness. We also noticed a decrease of trust in the voices of mainstream medical experts during the pandemic period, from about 92 % in 2019 to 73 % in 2021, and a significant increase in people who declared that they "don't know" whom to trust about vaccine information, ranging from 1 % to about 13 %. Measurements of vaccination confidence in Europe should control for acquiescence, through positively and negatively formulated items, and ensure comparability in time. We strongly recommend the inclusion of a battery of critical items in all future European Commission-funded surveys on vaccination to allow the monitoring of European public confidence in vaccination and in the relevant information sources, including trust in pharmaceutical companies; this will provide an avenue for re-establishing a broader confidence among citizens, health authorities, and specialists.

To be Direct or not: Reversing Likert Response Format Items.

Likert items are often used in social and health sciences. However, the format is strongly affected by acquiescence and reversed items have traditionally been used to control this response bias, a controversial practice. This paper aims to examine how reversed items affect the psychometric properties of a scale. Different versions of the Grit-s scale were applied to an adult sample (N = 1,419). The versions of the scale had either all items in positive or negative forms, or a mix of positive and negative items. The psychometric properties of the different versions (item analysis, dimensionality and reliability) were analyzed. Both negative and positive versions demonstrated better functioning than mixed versions. However, the mean total scores did not vary, which is an example of how similar means could mask other significant differences. Therefore, we advise against using mixed scales, and consider the use of positive or negative versions preferable.

Children's acquiescence to polysemous implicature questions about coaching: The role of parental support.

Children may be asked questions with subtle and implied meanings. The present study examined whether, and under what conditions, 5- to 10-year-old children affirmed polysemous implicature questions that implied coaching, when in fact no coaching occurred. Participants (N = 161) were presented with vignettes about a transgression where the child disclosed to a supportive or unsupportive parent, and were asked three polysemous implicature coaching questions (e.g., "Did the mom practice with the boy/girl what to say?"). Overall, children acquiesced to implied coaching questions, when in fact no coaching occurred (39% of the time), though acquiescence rates decreased with age and improved false-belief understanding. Furthermore, children were more likely to acquiesce when the mother was supportive, and when the question more subtly suggested coaching. These findings provide novel evidence of the developmental trajectory of children's understanding of polysemous implicatures and the underlying social-cognitive mechanisms, with implications for questioning children in investigative contexts.

Assessment of skin cancer precision prevention materials among Hispanics in Florida and Puerto Rico.

OBJECTIVE: To assess Hispanic participants' ratings of intervention materials and examine differences by language preference. METHODS: Participants on a skin cancer prevention trial were randomized to receive generic (n = 457) or precision prevention materials conveying average (n = 195) or higher genetic risk (n = 268) based on MC1R genotype. Three months after receiving either English or Spanish language prevention materials, participants reported amount read, believability and clarity of materials, and intention to change preventive behavior. RESULTS: Participants reported high levels on all four outcomes, but the precision prevention groups noted lower clarity than the generic group (p = 3.2 ×10-6). Participants preferring Spanish provided consistently higher scores than those preferring English. Among English-preferring participants, those in the precision prevention groups scored lower on all measures than those in the generic group. CONCLUSIONS: Skin cancer prevention materials were well-received by Hispanic participants. Higher scores among participants preferring Spanish may indicate acquiescence bias, or that translated prevention materials met their linguistic needs. Participants in the precision prevention groups with English language preference may have challenges in the uptake of genetic risk results. PRACTICE IMPLICATIONS: Availability of Spanish materials may have facilitated higher scores. Additional strategies should be explored to optimize participants' believability and clarity of precision prevention materials.

Suggested false memories of a non-existent film: forensically relevant individual differences in the crashing memories paradigm.

There is ample evidence to suggest that posing leading questions is dangerous, in that it may elicit compliant responses that are not necessarily accurate. Further, suggestive questioning is considered to possibly result in the development of false memories, implied in the suggestion. [Crombag, H. F. M., Wagenaar, W. A., & van Koppen, P. J. (1996). Crashing memories and the problem of 'source monitoring'. Applied Cognitive Psychology, 10(2), 95-104. https://doi.org/10.1002/(SICI)1099-0720(199604)10:2<95::AID-ACP366>3.0.CO;2-#] introduced a crashing memories paradigm in which participants are asked a single leading question about a non-existent film. The present research sought to replicate the false-memory-eliciting effect of the crashing memory induction. Further, we sought to explore associations with forensically relevant personality traits, particularly acquiescence, compliance, and suggestibility. In two studies, a significant minority of participants endorsed the leading question about the non-existent film (25.7%, and 38% respectively). We found no support for an association with acquiescence or compliance, but suggestibility was associated with the development of false memories.

The Scoring Challenge of Emotional Intelligence Ability Tests: A Confirmatory Factor Analysis Approach to Model Substantive and Method Effects Using Raw Item Scores.

The internal structure of ability emotional intelligence (EI) tests at item level has been hardly studied, and if studied often the predicted structure did not show. In the present study, an a priori model for responses to EI ability items using Likert response scales with a Situational Judgement Test (SJT) format is investigated with confirmatory factor analysis. The model consists of (1) a target EI ability factor, (2) an acquiescence factor, which is a method factor induced by the Likert response scales, and (3) design-based error covariances, which are induced by the SJT format. It is investigated whether this a priori model can account for the observed associations between the raw item responses of the Components of Emotion Understanding Test-24 (CEUT-24). The CEUT-24 is a new test developed to assess emotion understanding, a key aspect of the EI ability construct, based on the componential emotion framework. The sample consisted of 1184 participants (15-22 years old) from four European countries (United Kingdom, Belgium, Germany, and Spain) speaking four different languages (English, Dutch, German and Spanish). Findings showed that the a priori model fitted the data well in all four languages. Furthermore, measurement invariance testing gave evidence for a well-fitting configural, metric, and partial scalar invariance model. The conclusion is that within a regular CFA framework using raw observed items responses, method factors (acquiescence response style and scenario induced variance) can be disentangled from the targeted EI ability factor.

"Went Along With": Acquiescence During First Sexual Experience and Late-Life Health.

Working from a life course perspective, we examined how acquiescence (i.e., "lack of resistance") to an unwanted (i.e., "without experiencing a concomitant desire") first sexual experience was related to health and well-being in late life. Data were drawn from the second wave of the National Social Life, Health, and Aging Project (2010/11). The sample included 2558 older adults ages 62-99 (1182 men and 1376 women). Results from regression models suggested those respondents whose first sex was acquiesced reported higher levels of psychological distress and poorer physical health during late life than respondents whose first sex was wanted. Results from generalized structural equation modeling analysis further suggested that the association between acquiesced first sex and late-life health operated through adulthood socioeconomic status but not through marital relationships. We did not find gender differences in these processes.

Developing a short screener for acquiescent respondents.

BACKGROUND: Acquiescent response style (ARS) refers to survey respondents' tendency to choose response categories agreeing to questions regardless of their content and is hypothesized as a stable respondent trait. While what underlies acquiescence is debatable, the effect of ARS on measurement is clear: bias through artificially increased agreement ratings. With certain population subgroups (e.g., racial/ethnic minorities in the U.S.) are associated with systemically higher ARS, it causes concerns for research involving those groups. For this reason, it may be necessary to classify respondents as acquiescers or a nonacquiescers, which allows independent analysis or accounting for this stylistic artifact. However, this classification is challenging, because ARS is latent, observed only as a by-product of collected data. OBJECTIVES: To propose a screener that identifies respondents as acquiescers. METHODS: With survey data collected for ARS research, various ARS classification methods were compared for validity as well as implementation practicality. RESULTS: The majority of respondents was classified consistently into acquiescers or nonacquiescers under various classification methods. CONCLUSIONS: We propose a method based on illogical responses given to two balanced, theoretically distant multi-item measurement scales as a screener.

To be Direct or not: Reversing Likert Response Format Items

Likert items are often used in social and health sciences. However, the format is strongly affected by acquiescence and reversed items have traditionally been used to control this response bias, a controversial practice. This paper aims to examine how reversed items affect the psychometric properties of a scale. Different versions of the Grit-s scale were applied to an adult sample (N = 1,419). The versions of the scale had either all items in positive or negative forms, or a mix of positive and negative items. The psychometric properties of the different versions (item analysis, dimensionality and reliability) were analyzed. Both negative and positive versions demonstrated better functioning than mixed versions. However, the mean total scores did not vary, which is an example of how similar means could mask other significant differences. Therefore, we advise against using mixed scales, and consider the use of positive or negative versions preferable. (AU)

Modeling Wording Effects Does Not Help in Recovering Uncontaminated Person Scores: A Systematic Evaluation With Random Intercept Item Factor Analysis.

The item wording (or keying) effect consists of logically inconsistent answers to positively and negatively worded items that tap into similar (but polarly opposite) content. Previous research has shown that this effect can be successfully modeled through the random intercept item factor analysis (RIIFA) model, as evidenced by the improvements in the model fit in comparison to models that only contain substantive factors. However, little is known regarding the capability of this model in recovering the uncontaminated person scores. To address this issue, the study analyzes the performance of the RIIFA approach across three types of wording effects proposed in the literature: carelessness, item verification difficulty, and acquiescence. In the context of unidimensional substantive models, four independent variables were manipulated, using Monte Carlo methods: type of wording effect, amount of wording effect, sample size, and test length. The results corroborated previous findings by showing that the RIIFA models were consistently able to account for the variance in the data, attaining an excellent fit regardless of the amount of bias. Conversely, the models without the RIIFA factor produced increasingly a poorer fit with greater amounts of wording effects. Surprisingly, however, the RIIFA models were not able to better estimate the uncontaminated person scores for any type of wording effect in comparison to the substantive unidimensional models. The simulation results were then corroborated with an empirical dataset, examining the relationship between learning strategies and personality with grade point average in undergraduate studies. The apparently paradoxical findings regarding the model fit and the recovery of the person scores are explained, considering the properties of the factor models examined.

Is It Time to Go Positive? Assessing the Positively Worded System Usability Scale (SUS).

OBJECTIVE: The goal of the research presented in this paper was to determine if the positively worded System Usability Scale (SUS) can be used in place of the positively and negatively worded standard SUS instrument for the subjective assessment of usability, and whether the results found here replicate those of Sauro and Lewis. BACKGROUND: Sauro and Lewis' previous study found no evidence that responses to SUS items differed across the standard SUS and the modified, positively worded version of the SUS when participants assessed websites. This study replicates and extends this work by examining a large number of different systems with larger sample sizes to add to the generalizability of previous findings. METHODS: So that participants could retrospectively assess 20 products, the standard SUS was administered to 268 participants and the positive SUS to 698 participants. SUS scores were computed and the data analyzed using psychometric methods to explore how the two versions of the SUS differed. RESULTS: The standard and positive versions of the SUS yielded similar SUS scores. In addition, both versions of the scale demonstrated evidence in support of reliability and validity. CONCLUSION: Either version of the SUS can be used with confidence to measure subjective usability. Furthermore, the scores generated from both versions of the SUS can be directly compared. APPLICATIONS: In situations where cognitive load, participants' spoken language, or item consistency with other surveys being given may be a factor, the positive SUS is a viable alternative to the standard SUS.

Evidence for the Factorial Validity of the Beck Hopelessness Scale in Spanish with Clinical and non-Clinical Samples / Evidencias de validez factorial de la Escala de desesperanza de Beck en español con muestras clínicas y no clínicas

Abstract The purpose of the present study is to evaluate the internal structure of the Spanish adaptation of the Beck Hopelessness Scale (Beck et al., 1974) given its usefulness and relevance in the prediction of suicidal behaviors. The responses to the scale of 1260 university students (M = 4.79, SD = 4.29) and of a clinical sample in which 150 young people with suicide attempt of high lethality (M = 8.51, SD = 2.38) participated were analyzed. The internal structure of the scale is examined by confirmatory factor analysis (CFA) in three phases. In the first phase, the original model is compared with four models found in the different adaptations to Spanish; in the second phase, models that analyze acquiescence are taken into account, and in the third phase, a cross-validation of those models with a clinical population is made. The results indicate that the scale is one-dimensional both in the case of clinical samples (χ2 = 154.84, gl = 135, p <0.001, CFI = 0.99, TLI = 0.99, RMSEA = 0.03), as well as in the general population. However, for the latter, a method factor was added for the treatment of acquiescence (χ2 = 252.14, gl = 134, p <0.001, CFI = 0.95, TLI = 0.94, RMSEA = 0.03). The results show the importance of using analyzes and models that consider the nature of the data and the characteristics of the sample to provide more solid evidence for construct validity.

Resumen El propósito del presente estudio fue evaluar la estructura interna de la adaptación al español de Escala de Desesperanza de Beck et al. (1974), dada su utilidad y relevancia en la predicción de conductas suicidas. Para esto, se analizaron las respuestas a la escala de 1260 estudiantes universitarios (M = 4.79; DT = 4.29) y de una muestra clínica en la que participaron 150 jóvenes con intento de suicidio de alta letalidad (M = 8.51; DT = 2.38). Se examinó la estructura interna por medio del Análisis factorial confirmatorio (AFC) en tres fases: en la primera, se comparó el modelo original con cuatro modelos encontrados en las diferentes adaptaciones al español; en la segunda, se tomaron en cuenta modelos que analizan la aquiescencia; y en la tercera, se hizo una validación cruzada de esos modelos con población clínica. Los resultados señalan que la escala es unidimensional tanto en el caso de las muestras clínicas(χ2 = 154.84, gl = 135, p < 0.001, CFI = 0.99, TLI = 0.99, RMSEA = 0.03) como en la población universitaria; sin embargo, a esta última se le añadió un factor de método para el tratamiento de la aquiescencia (χ2 = 252.14, gl = 134, p < 0.001, CFI = 0.95, TLI = 0.94, RMSEA = 0.03). Los resultados muestran la importancia de utilizar análisis y modelos que consideren la naturaleza de los datos y las características de la muestra para aportar evidencias más sólidas para la validez de constructo.

INCA-M: Mexican Adaptation of the Inventory of Callous-Unemotional Traits and Antisocial Behavior.

Callous-unemotional traits are considered to be precursors of psychopathy, and are related to behaviors such as aggression, delinquency, antisocial behavior, and bullying in adolescents. For this reason, it is important to study these traits in childhood and adolescence with appropriate and reliable instruments. The aim of the current study is to develop a Mexican adaptation of the Inventory of Callous-Unemotional Traits and Antisocial Behavior (INCA) because few questionnaires in Spanish assess these traits, and even fewer have been validated for the Mexican population. The INCA questionnaire, developed in Spain, assesses the same three factors as the ICU questionnaire (unemotional, callousness, and uncaring), and it includes an additional factor of antisocial behavior with items on challenging authority and breaking social rules. It controls two response biases: social desirability and acquiescence. We administered the Mexican adaptation, named INCA-M, to 699 adolescents aged between 12 and 18 years old. Factor analysis yielded three dimensions, because most of the items referring to uncaring and antisocial behavior loaded on a common factor, which can be explained by cultural differences. We decided to remove these items of antisocial behavior so as to maintain the same three factors assessed by the ICU questionnaire. The results suggest that the INCA-M has good psychometric properties, with high factor simplicity and good reliability. Moreover, we found the expected correlations with impulsivity and the Big Five subscales, and also with the equivalent subscales assessed by the ICU questionnaire.

Measuring hope amongst Tanzanian women who participate in microfinance: An evaluation of the Snyder hope scale.

Measuring hope reliably and accurately remains an important research objective, not least in less prosperous settings where 'holding on to hope' may be critically important in the struggle against adverse life conditions. The State Hope Scale was designed for use in the US. Despite reported application in diverse cultures and using translations the scale has not been extensively validated outside US populations. This study contributes to a larger project exploring the measurement of hope and provides a critique of Snyder's scale as used in a Tanzanian female population of 1021 urban microfinance participants. We evaluate the scale's validity through assessment of the empirical distribution of scores, item response profiles, internal consistency and discriminatory ability. Participants mostly scored very high and many reached very near the maximum attainable score. Hardly any endorsed the negative half of the response scale. Several problems are discussed including poor discrimination and strong evidence of acquiescence response bias. We also found little association of the scale scores with hypothesised correlates of hope. Future improvements on the measurement of hope are recommended, especially in studies outside the narrow Western context in which the scale was devised.

Can mindfulness overcome the effects of workplace ostracism on job performance?

With a basis in the transactional theory of stress and coping, this study investigates the relationship between employees' exposure to workplace ostracism and their job performance, while also considering the mediating role of acquiescence silence and the moderating role of mindfulness. Multisource, three-wave data from employees and their peers in Pakistani organizations reveal that ostracism in the workplace hinders job performance because employees passively withhold relevant ideas about their work due to feelings of acquiescence. The mediating role of acquiescence silence is mitigated if employees can draw from their mindfulness trait. This study accordingly identifies a key mechanism - the passive withholding of pertinent ideas, based on submission - by which workplace ostracism hampers job performance, and it reveals how this process might be contained by encouraging employees' receptive attention and awareness focused on present experiences.

Controlling for Response Biases in Self-Report Scales: Forced-Choice vs. Psychometric Modeling of Likert Items.

One important problem in the measurement of non-cognitive characteristics such as personality traits and attitudes is that it has traditionally been made through Likert scales, which are susceptible to response biases such as social desirability (SDR) and acquiescent (ACQ) responding. Given the variability of these response styles in the population, ignoring their possible effects on the scores may compromise the fairness and the validity of the assessments. Also, response-style-induced errors of measurement can affect the reliability estimates and overestimate convergent validity by correlating higher with other Likert-scale-based measures. Conversely, it can attenuate the predictive power over non-Likert-based indicators, given that the scores contain more errors. This study compares the validity of the Big Five personality scores obtained: (1) ignoring the SDR and ACQ in graded-scale items (GSQ), (2) accounting for SDR and ACQ with a compensatory IRT model, and (3) using forced-choice blocks with a multi-unidimensional pairwise preference model (MUPP) variant for dominance items. The overall results suggest that ignoring SDR and ACQ offered the worst validity evidence, with a higher correlation between personality and SDR scores. The two remaining strategies have their own advantages and disadvantages. The results from the empirical reliability and the convergent validity analysis indicate that when modeling social desirability with graded-scale items, the SDR factor apparently captures part of the variance of the Agreeableness factor. On the other hand, the correlation between the corrected GSQ-based Openness to Experience scores, and the University Access Examination grades was higher than the one with the uncorrected GSQ-based scores, and considerably higher than that using the estimates from the forced-choice data. Conversely, the criterion-related validity of the Forced Choice Questionnaire (FCQ) scores was similar to the results found in meta-analytic studies, correlating higher with Conscientiousness. Nonetheless, the FCQ-scores had considerably lower reliabilities and would demand administering more blocks. Finally, the results are discussed, and some notes are provided for the treatment of SDR and ACQ in future studies.

Contextual Responses to Affirmative and/or Reversed-Worded Items.

This paper presents a systematic investigation of how affirmative and polar-opposite items presented either jointly or separately affect yea-saying tendencies. We measure these yea-saying tendencies with item response models that estimate a respondent's tendency to give a "yea"-response that may be unrelated to the target trait. In a re-analysis of the Zhang et al. (PLoS ONE, 11:1-15, 2016) data, we find that yea-saying tendencies depend on whether items are presented as part of a scale that contains affirmative and/or polar-opposite items. Yea-saying tendencies are stronger for affirmative than for polar-opposite items. Moreover, presenting polar-opposite items together with affirmative items creates lower yea-saying tendencies for polar-opposite items than when presented in isolation. IRT models that do not account for these yea-saying effects arrive at a two-dimensional representation of the target trait. These findings demonstrate that the contextual information provided by an item scale can serve as a determinant of differential item functioning.

Item Response Tree Models to Investigate Acquiescence and Extreme Response Styles in Likert-Type Rating Scales.

Item response tree (IRTree) models are recently introduced as an approach to modeling response data from Likert-type rating scales. IRTree models are particularly useful to capture a variety of individuals' behaviors involving in item responding. This study employed IRTree models to investigate response styles, which are individuals' tendencies to prefer or avoid certain response categories in a rating scale. Specifically, we introduced two types of IRTree models, descriptive and explanatory models, perceived under a larger modeling framework, called explanatory item response models, proposed by De Boeck and Wilson. This extends the typical application of IRTree models for studying response styles. As a demonstration, we applied the descriptive and explanatory IRTree models to examine acquiescence and extreme response styles in Rosenberg's Self-Esteem Scale. Our findings suggested the presence of two distinct extreme response styles and acquiescence response style in the scale.